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SUMMARY 


The  purpose  Of  this  research  was  to  show  the  validity  of  the  Air  Force  Officer  Qualifying 
Test  (AFOQT)  by  comparing  Its  five  composites  with  performance  In  non-rated  technical  training 
courses  (TTCs).  The  AFOQT  Is  a  p&per-and-pencll  aptitude  test  battery  that  Is  used  to  wake 
selection  and  classification  decisions  on  officers.  The  most  recent  study  to  show  the  validity 
of  the  AFOQT  across  several  non-.-ated  officer  specialties  was  accomplished  In  1969.  This  work 
updated  the  earlier  research  by  examining  20  non-rated  officer  utilization  fields.  Data  were 
obtained  on  9,029  officers  who  attended  37  TTCs  between  October  1979  and  December  1983.  Of  these 
TTCs,  29  were  entry  level  and  8  were  advanced  level  courses.  Correlations  were  computed  among 
the  AFOQT  composite  scores  and  final  school  grade  In  the  TTCs.  Results  showed  positive  and 
significant  c  r relations  In  most  of  the  TTCs,  especially  the  entry  level  courses.  It  was  also 
demonstrated  tn.it  some  rated  composites  had  higher  correlations  than  non-rated  composites  In 
particular  specialties.  Regression  analyses  were  performed  to  optimally  weight  the  composites  to 
enhance  their  predictability.  It  was  concluded  the  AFOQT  Is  a  valid  instrument  for  use  In 
predicting  Initial  TTC  performance  for  non-rated  officers.  These  results  could  be  used  as  a 
starting  point  to  establish  an  Improved  classification  system  for  non-rated  officers.  Future 
research  will  compare  AFOQT  subtest  data  with  TTC  performance  In  order  to  form  new  composites  for 
selected  specialties. 


PREFACE 


This  study  was  completed  under  Task  771918,  Selection  and  Classification 
Technologies,  which  Is  part  of  a  larger  effort  In  Force  Acquisition  and  Distribution. 
It  was  subsumed  under  work  unit  number  77191847,  Development  and  Validation  of  civilian 
and  Mon-rated  Officer  Selection  Methodologies.  This  work  unit  was  established  In 
response  to  Air  Force  Regulation  35-8,  Air  Force  Military  Personnel  Testing  System. 

Personal  In  the  Air  Force  Hiaaan  Resource;  Laboratory  Technical  Services  Division, 
especially  Mr.  Henry  Clark,  contributed  significantly  to  this  project. 
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VALIDATION  OF  THE  AFOOT  FOR  NON-RATED  OFFICERS 


I.  INTRODUCTION 

The  objective  of  this  project  was  to  evaluate  the  validity  of  the  Air  Force  Officer 
Qualifying  Test  (AFOOT)  by  co^arlng  Its  composites  with  training  performance  measures.  This 
Information  Is  Important  to  Individuals  who  use  test  scores  In  selection  and  classification 
derisions.  Regulations  governing  training  programs  specify  other  data  may  be  used  for  these 
decisions,  such  as  a  physical  examination,  educational  history,  or  evaluation  by  officer  boards. 
However,  AFOOT  scores  are  a  major  objective  component  of  all  selection  and  classification 
decisions.  Recently,  Interest  has  been  expressed  In  Improving  the  officer  classification 
system.  The  results  of  this  study  could  be  used  to  better  classify  non-rated  officers.  By 
assigning  weights  to  their  existing  composite  scores,  officers  could  be  given  assignments  that 
match  their  aptitudes  and,  therefore,  would  Increase  their  expected  performance  In  technical 
training  courses. 

The  AFOQT  Is  a  paper-and-pencll  aptitude  test.  There  have  been  15  forms  since  It  was  first 
Introduced  In  1953.  Only  results  from  the  more  recent  forms  (L,  M,  N,  and  0)  were  used  In  this 
study.  All  of  these  forms  yield  five  composites:  Pilot,  Navigator-Technical  (the  rated 
composites).  Academic  Aptitude  Verbal,  and  Quantitative  (the  non-rated  composites). 

Host  AFOQT  validation  studies  have  focused  on  the  rated  specialties  (pilot  and  navigator). 
Some  examples  Include  those  studies  done  by  Hiller  ( 1 966)  and  Valentine  (1977).  Validation  wo'lc 
on  non-rated  specialties  has  been  less  coa^rehenslve.  Usually,  a  particular  field  Is  designated 
and  the  validity  work  concentrates  on  that  area  alone.  FlnegoTd  and  Rogers  (1985)  reported  on 
air  weapons  controllers.  In  1960,  Hiller  examined  seven  non-rated  officer  courses  and,  In  1969, 
he  compared  the  AFOQT  with  i7  non-rated  specialties  along  with  various  ether  measures.  However, 
the  latter  two  studies  by  Hiller  were  the  only  ones  taking  a  comprehensive  approach  to  the 
non-rated  specialties  and  are  now  outdated.  The  present  study  updates  the  earlier  work  by 
examining  the  validity  of  the  AFOQT  In  37  non-rated  technical  training  courses  within  20  of  the 
major  Air  Force  officer-utilization  fields. 


II.  METHOD 

Data  were  obtained  on  9,029  officers  who  attended  one  of  37  technical  training  courses 
between  October  1979  and  December  1983.  Of  these  courses,  29  were  entry  level  (skill  level 
identifiers  of  0  or  1),  while  the  remainder  were  upper  level  courses  (skill  level  Identifiers  of 
4,  5,  or  6).  The  courses  analyzed  were  limited  to  those  In  which  at  least  75  Individuals  had 
non-rated  (l.e..  Academic  Aptitude,  Verbal,  and  Quantitative)  composite  scores.  This  was  done  to 
Insure  stability  of  the  results.  Not  all  subjects  took  the  rated  portion  of  the  AFOQT  (the  Pilot 
and  Navigator-Technical  composites),  so  the  number  of  cases  occasionally  fall  below  7b  within 
each  course.  Of  the  total  number  of  ol  leers  In  this  study,  8.2%  tested  on  AFOQT-L,  19.9%  took 
AFOQT -H.  62.9%  took  AFOQT-N,  and  9.0%  were  administered  AFOQT -0.  These  data  were  available  from 
files  maintained  at  the  Air  Force  Hunan  Resources  Laboratory. 

Predictor  variables  In  this  study  were  the  five  composites  of  the  AFOQT.  These  composites 
are  made  up  of  suss  of  partly  overlapping  sets  of  subtests  and  are  expressed  In  percentiles. 
Table  1  shows  how  the  composites  are  derived  from  the  16  subtests  that  form  the  current  AFOQT 
(Form  0).  Successive  forms  of  the  AFOQT  resemble  each  other  but  differ  In  some  respects.  There- 


fore,  all  forms  have  been  equated  to  each  other  to  yield  coemwn  metric  percentiles.  Common 
metric  percentiles  were  used  In  these  analyses. 


Table  1.  Construction  of  AFOQT  Form  0  Co^rosites 


AFOQT  Subtests 

AFOQT  Co^x)  sites 

Pilot 

Navigator- 

Technical 

Academic 

Aptl  turte 

Verbal 

Quantitative 

Verbal  Analogies 

X 

X 

X 

Arithmetic  Reasoning 

X 

X 

X 

Reading  Coa^rehenslon 

X 

X 

Data  Interpretation 

X 

X 

X 

Word  Knowledge 

X 

X 

Hath  Knowledge 

X 

X 

X 

Mechanical  Comprehension 

X 

X 

Electrical  Maze 

X 

X 

Scale  Reading 

X 

X 

Instrument  Comprehension 

X 

Block  Counting 

X 

X 

Table  Reading 

X 

X 

Aviation  Information 

X 

Rotated  Blocks 

X 

General  Science 

X 

Hidden  Figures 

X 

Note:  All  applicants  are  required  to  take  all  portions  of  the  AFOQT 
only  since  Implementation  of  AFOQT -0. 


The  criterion  variable  was  the  final  school  grade  earned  In  each  training  course.  These 
grades  are  expressed  In  percentages  and  range  from  a  low  of  60  to  a  high  of  99.  Only  numeric 
final  school  grains  were  used  for  the  correlations.  A  very  sa»an  percentage  of  final  grades  were 
reported  as  either  unknown  or  as  satisfactory/unsatisfactory  and  were  not  used  In  the  analyses. 

Pearson  prcduct-moment  correlations  were  computed  between  each  of  the  five  composites  and  the 
officers'  final  school  grade.  This  analysis  was  conducted  separately  for  each  course. 
Regression  analyses  were  then  computed  on  the  data  using  the  models  described  In  the  appendix. 
This  was  done  to  determine  the  optimal  weights  that  could  be  assigned  to  the  existing  non-rated 
composites  In  order  to  enhance  their  predictability. 


III.  RESULTS 

In  Table  2,  correlations  between  the  AFOQT  composites  and  final  school  grade  are  shown.  The 
majority  of  correlations  are  positive  and  statistical ly  significant.  Correlations  ranged  from  a 
low  of  .01  to  a  high  of  .62;  most  were  In  the  range  of  .20  to  .40.  Results  showed  that  In  some 
cases  (l.e.,  courses  1631  and  8031  )  the  Pilot  and  Navigator- Technical  composites  correlate  higher 
with  success  In  the  technical  training  courses  than  some  of  the  non-rated  composites.  In  other 
cases,  correlations  for  the  rated  composites  did  not  reach  significance  even  though  they  are 
similar  to  the  correlations  obtained  for  the  non-rated  composites  (l.e.,  courses  3016  and  6221). 
This  was  probably  due  to  the  fact  the  number  of  subjects  In  those  cells  was  too  small. 
Additionally,  many  more  AFOQT  composites  reached  significance  In  entry  courses  than  In  advanced 
courses . 


Rated  Composite* _ Non-Rated  Composites 

Utilization  Field  Navigator-  Acs  dearie  Quantl- 

and  Course  ID _ N  Pilot  technical  K  Aptitude  Verbal  tatlve 


Air  Traffic  Control 


1631 

49 

.59** 

.59** 

91 

■  SO** 

.39** 

.51** 

Air  Weapons  Director 

1741 A 

107 

.31** 

.38** 

217 

.31** 

.16** 

.40** 

1 741 D 

54 

.34* 

.  44** 

109 

.41** 

.29** 

1 741 X 

309 

.27** 

.32** 

593 

.34** 

.28** 

.35** 

1  744A 

59 

.17 

-33** 

120 

.17 

.09 

.16 

Missile  Operations 

1 821 F 

169 

.37** 

.45** 

456 

.55** 

.43** 

.48** 

Space  Systems 

2001 

116 

.36** 

.30** 

185 

.43** 

.38** 

.35** 

2031 

90 

.28** 

.25* 

145 

.36** 

.30** 

.27** 

Weather 

2524 

28 

.38* 

.43* 

78 

.08 

-.07 

.27 

Communlcatlons-Electronlcs 

3016 

33 

.30 

.36* 

97 

.28** 

.29** 

.20* 

3021 

111 

.43** 

.45** 

382 

.44** 

.41** 

.36** 

30240 

33 

.46** 

.54** 

113 

.47** 

.39** 

.37** 

3031 

80 

.36** 

.43** 

326 

.41** 

.35** 

.40** 

3051 

119 

.05 

.09 

215 

.28** 

.22** 

.27** 

Aircraft  Maintenance 

and  Munitions 

4021 

no-i 

JJl 

.26** 

IC** 

«  ww 

850 

.  31** 

.  25** 

.  32** 

4051 A 

131 

.44** 

.49** 

264 

.48** 

.44** 

.43** 

4054X 

36  - 

.17 

.30 

98 

.05 

.14 

-.01 

Computer  Systems 

51 31 B 

85 

.26* 

.  34** 

308 

.49** 

.43** 

.50** 

51356 

35 

.32 

.46** 

89 

.33** 

.32** 

.41** 

Transportation 

6051 

106 

.37* 

.46** 

354 

.52** 

.49** 

.42** 

Services 

6221 

64 

.23 

.23 

186 

.26** 

.23** 

.22** 

Supply  Management 

6421 

104 

.20* 

.3?** 

324 

.35** 

.32** 

.30** 

6424 

35 

.35* 

.38* 

103 

.33** 

.36** 

.29** 

Acquisition  Contractl r.g/Hanufacturlng 

6531 

108 

.19 

.29** 

248 

.41** 

.39** 

.31  ** 

6534 

45  - 

.08 

.04 

109 

.17 

.21* 

.15 

logistics  Plans  and  Programs 

6621 

60  - 

.01 

.18 

129 

.31** 

.35** 

Financial 

6721 

26 

.05 

.12 

114 

.30** 

.29** 

.30** 

6731 

33 

.31 

.23 

121 

.27** 

.26** 

.25** 

Management  Analysis 

6921 

47 

.31* 

.42** 

124 

.36** 

.28** 

.33** 

Acinlnlstratlon 

184 

.28** 

25** 

.15** 

15** 

Rated  Cog>os1tes  _ Hon-Rated  Composites 


Utilization  Field 
and  Course  10 

N 

Pilot 

Navigator- 

technical 

N 

Acadaalc 

Aptitude 

Verbal 

Quantl  - 
tatlve 

Personnel 

7321 

62 

.  35** 

.35** 

292 

.42** 

.  38** 

.34** 

Manpower  Management 

7421 

48 

.26 

.27 

145 

.48** 

.45** 

.40** 

Intelligence 

8000 

61 

.36** 

.46** 

168 

.50* 

.44** 

.41** 

8031 

SI 

.55** 

.62** 

159 

.  5G‘* 

.39** 

.43** 

8041 

68 

.44** 

.4?** 

141 

.44** 

.34** 

.42** 

8051 

159 

.34** 

.42** 

420 

.46** 

.41"* 

.43** 

Security  Police 

8121 

78 

.21 

.28* 

286 

.39** 

.42** 

.30** 

Note:  Reported  coefficients  have  not  been  corrected  for  restriction  In 
range. 

*  -  Significant  at  .05  level. 

**  -  Significant  at  .01  level. 


The  obtained  correlations  probably  underestimate  the  true  relationship  between  AFOQT 
composite  scores  and  final  school  grade.  Officers  who  attended  these  courses  had  been  screened 
on  the  AFOQT  (Verbal  05  standard).  Therefore,  applicants  with  scores  too  low  for  commissioning, 
and  thus  for  technical  school  training,  were  excluded.  However,  because  only  the  lower  6t  of 
scores  were  omitted,  the  correlation  values  are  not  expected  to  be  greatly  Influenced. 

Presently,  only  the  nor, -rated  composites  are  used  to  select  Individuals  Into  non-rated 
technical  training  courses.  Therefore,  regressions  using  the  models  described  In  the  appendix 
were  computed  using  the  three  non-rated  composites.  Table  3  shows  which  non-rated  composites 
could  be  used  most  effectively  to  predict  training  success.  The  regression  equations  are  derived 
by  multiplying  the  weight  In  the  table  by  the  appropriate  composite  score  and  adding  the  product 
to  the  regression  constant.  The  result  Is  the  predicted  technical  training  course  final  grade. 

Multiple  Rs'  for  significant  combinations  of  Verbal.  Quantitative,  and  Academic  Aptitude 
ranged  from  .086  to  .560.  In  a  majority  of  cases,  a  linear-weighted  combination  of  Verbal  and 
Quantitative  (and  occasionally  Academic  Aptitude)  predicted  final  grades  significantly  better 
than  the  use  of  single  composites  alone.  The  relative  contribution  of  each  of  the  composites,  as 
Indexed  by  the  regression  weight,  varied  considerably  across  the  courses.  Grades  In  courses 
1 744A.  6221 .  and  8131  for  example  were  determined  primarily  by  Verbal  aptitude.  Others  such  as 
1631  and  6921  were  better  predicted  by  the  Quantitative  composite  alone,  whereas  a  mix  of  Vertal 
and  Quantitative  abilities  Is  required  for  1821 F,  3021  ,  and  8031. 

In  seven  of  the  officer  specialties  (17410,  1744X,  2031  ,  3051  ,  6221  ,  6731  ,  and  6921  ),  the 
highest  zero-order  correlations  were  obtained  for  the  Academic  Aptitude  composite.  However, 
Academic  Aptitude  did  not  add  unique  predictive  power  over  and  above  the  Verbal  and  Quantitative 
composites  combined.  Thus,  it  was  excluded  from  the  final  model. 


Table  3.  Regression  Equations  and  Multiple  P.'s  for  Composite  Combinations 


AFOOT  Composite  Coafelnatlons 


Utilization  Field 
and  Course  ID 

Regression  Academic 

constant  aptl tude 

Verbal 

Quantitative 

Multi  pT 
R 

Air  Traffic  Control 

1631 

78.380 

.134  (.512) 

.512 

Air  Weapons  Director 

1741 A 

92. 360 

.054  (.396) 

.396 

1 7410 

85.781 

.096  (.401) 

.401 

1741 X 

91.536 

.023  (.283) 

.045  (.346) 

.370 

1744A 

87.789 

.025  (.086) 

.086 

Missile  Operations 

1 821 F 

87.273 

.050  (.480) 

.053  (.477) 

.560 

Space  Systems 

2001 

86.754 

.047  (.384) 

.040  (.354) 

.425 

2031 

76.702 

.088  (.305) 

.305 

Weather 

2524 

75.595 

.118  (.265) 

.265 

Coflwinlcatl  ons-Electronl  cs 

3016 

86.982 

.086  (.285) 

.285 

3021 

83.116 

.055  (.408) 

.044  (.359) 

.443 

30240 

75.328 

.081  (.394) 

.106  (.368) 

.466 

3031 

84.010 

.032  (.349) 

.056  (.400) 

.429 

3051 

84.174 

.058  (.267) 

.257 

Aircraft  Maintenance  and  Munitions 

iA<S1 

•rut  i 

O')  OA1 
w*-«  ■>  v  • 

.026  (.247) 

.06?  M25) 

,342 

4051 A 

81.221 

.063  (.436) 

.061  (.425) 

.500 

4054X 

89.766 

.025  (.140) 

,140 

Computer  Systems 

51 318 

82.571 

.034  (.426) 

.073  (.502) 

.525 

5135B 

81  .508  -.192  (.335) 

.145  (.320) 

.172  (.410) 

.504 

Transportation 

6051 

83.731 

.060  (.494) 

.038  (.420) 

.525 

Services 

6221 

84.876 

.052  (.228) 

.228 

Supply  Management 

6421 

79.098 

.060  (.317) 

.061  (.303) 

.353 

6424 

86.469 

.093  (.356) 

.356 

Acqul si tl on  Contractl ng/Manufactur Ing 

6531 

77.250 

.089  (.386) 

.051  (.308) 

.411 

6534 

84.712 

.056  (.206) 

.206 

Logistics  Plans  and  Programs 

6621 

84.505 

.071  (.350) 

.350 

Financial 

6721 

87.058 

.055  (.305) 

.305 

6731 

83.476 

.075  (.258) 

.258 

Management  Analysis 

6921 

84.996 

.063  (.328) 

.328 

Administration 

7000 

84.377  -.089  (.348) 

.113  (.352) 

.081  (.289) 

.385 

Personnel 

7321 

82.602 

.070  (.378) 

.060  (.335) 

.429 

V-,-f 

lv-\<V 

l".  -/V -J 
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Table  3.  (Concluded) 


AFOQT  Composite  Coefr  (nations 


Utilization  Field 
and  Course  10 

Regression 

constant 

Academic 
aptl  tude 

Verbal 

Quantitative 

Mul  ti  ole 
R 

Manpower  Management 

7421 

78.211 

.078  (.447) 

.065  (.397) 

.507 

Intel  1 Igence 

8000 

79.862 

.069  (.444) 

.055  ( ,414) 

.515 

8031 

88.740 

.037  (.385) 

.043  (.434) 

.498 

8041 

81.659 

.038  (.341  ) 

.058  (.422) 

.  4C9 

8051 

80.640 

.051  (.412) 

.058  (.433) 

.491 

Security  Police 

81 21 

76.250 

.109  (.416) 

.416 

Motes:  Of  the  seven  possible  outcomes,  only  four  models  were  significant. 
Values  shown  In  parentheses  are  zero-order  correlations  of  Individual  composites  and 
final  school  grade.  The  regression  equations  are  derived  by  adding  the  regression 
constant  to  the  product  of  the  composite  score  multiplied  by  ~Jie  weight.  For 
example.  In  AFSC  8121,  76.250  +  .109  x  Verbal  composite  score  »  predicted  final 
school  grade. 


IV.  DISCUSSION  AND  CONCLUSIONS 

Performance  on  the  AFOQT  has  been  found  to  be  strongly  related  to  success  In  Initial 
training.  Earlier  studies  In  non-rated  specialties  were  reDllcated  In  that  significant  and 
positive  correlations  were  found  between  AFOQT  scores  and  technical  training  school  success. 
This  was  the  case  across  virtually  all  courses  examined,  although  to  a  lesser  extent  with  the 
advanced  training  courses.  For  example.  In  the  Aircraft  Maintenance  and  Munition  utilization 
field,  all  composites  correlate  positively  (p  <  .01)  for  Initial  courses  (4021  and  4051A). 
However,  for  the  advanced  course  (4054X),  none  of  the  composites  was  significantly  related  to 
final  school  grade. 

There  was  considerable  evidence  that  more  than  one  composite  was  related  to  training 
success.  Zero-order  correlations  across  all  five  composites  were  positive  and  significant  In 
most  courses.  Furthermore,  results  from  the  regression  analyses  revealed  that  a  confclnatlon  of 
composites  best  predicted  training  success  in  20  of  the  37  courses  analyzed.  These  findings 
suggest  that  performance  In  technical  training  is  multi -dimensional  and  varies  across  specialties. 

The  latter  conclusion  gives  a  strong  Indication  that  future  research  should  focus  on 
differential  predictions  for  each  specialty.  With  the  current  procedure  for  obtaining  AFOQT 
subtest  scores.  It  would  be  possible  to  compute  additional  regression  analyses  using  subtest 
Information.  New  composites  could  be  formed  for  each  course  by  optimally  weighting  the 
appropriate  subtests.  As  more  examinees  who  have  taken  Form  0  enter  and  complete  technical 
training  school,  these  analyses  would  be  feasible. 

The  potential  benefits  from  this  and  follow-on  studies  are  enormous  If  the  results  are 
Implemented.  Average  training  costs  could  be  reduced  considerably  by  lowering  the  academic 
attrition  rate  or  by  shortening  course  length  while  still  maintaining  current  training 
achievement  levels.  Moreover,  If  training  success  carries  over  to  on-the-job  performance, 
additional  savings  through  Increased  job  proficiency  could  be  realized. 
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APPENDIX  A:  SPECIFICATIONS  FOR  MULTIPLE  LINEAR  REGRESSION  ANALYSIS 
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Table  A-1 .  Specifications  for  Regression  Modal 


Nodal 

Component  Predictors 

L: 

1 

f  -  U  ♦  Acadealc  Aptitude  ♦  Verbal  ♦  Quantitative 

^  A*. 

V'V  V 

1 

2 

Y‘  ■  U  ♦  Verbal  +  Quantitative 

3 

V  •  U  +  Acadealc  Aptitude  +  Verbal 

N 

4 

V*  ■  U  +  Acadealc  Aptitude  +  Quantitative 

*«*>•« 

5 

Y*  ■  U  *  Acadealc  Aptitude 

,  ** .  \*s 

>  -■ 

6 

V  »  U  ♦  Verbal 

.  ■*.  *  _  ■ 

7 

Y*  •  U  +  Quantitative 

V 


L-.-. 

I 


■’  kfCiN  V  V  J1  V  v 


lAeTiW  ^  i 


.  -  «  *•  h.  -  *. 


.  .  **.  -*, 
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